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Abstract. We review a method of control for Hamiltonian systems which is able to create 
smooth invariant tori. This method of control is based on an apt modification of the perturbation 
which is small and localized in phase space. 



1. Introduction 

Controlling chaotic transport is a key challenge in many branches of physics like for instance, in 
particle accelerators, free electron lasers or in magnetically confined fusion plasmas. For these 
systems, it is essential to control transport properties without significantly altering the original 
system under investigation nor its overall chaotic structure. Here we review a control strategy 
for Hamiltonian systems which is based on building barriers by adding a small apt perturbation 
which is localized in phase space, hence confining all the trajectories. For more details on the 
methods (including exact results and numerical implementations, we refer to Refs. ^ HI 01 IS ED- 

We consider the class of Hamiltonian systems that can be written in the form H = Hq + V 
i.e. an integrable Hamiltonian Hq (with action-angle variables) plus a small perturbation V . 
Generically, it is expected that the phase space of is a mixture between regular and chaotic 
behaviors. The transition to Hamiltonian chaos occurs by successive break-ups of invariant 
KAM tori which foliate the phase space of Hq. For two degrees of freedom, it is worthwhile 
noticing that this transition is very similar to phase transitions in statistical mechanics, in the 
sense that it can be described by hyperbolic invariant sets of a renormalization operator [fillZIIHl- 

More than 25 years ago, Chirikov |9] stated an empirical criterion based on the overlap of 
primary resonances in order to get an idea on how chaos arises in Hamiltonian systems and to 
get rough estimates of the threshold of large scale diffusion. The idea of Chirikov is that chaos 
is obtained when the primary resonant islands overlap, i.e., when the distance between two of 
them is smaller than the sum to their half- widths. We now consider a small modification of 
the original system He = Hq + V + f (where / is smaller than V with an appropriate norm 
of functions). The perturbation / introduces generically additional resonances. Therefore from 
Chirikov's criterion, it is expected that there will be more overlaps of resonant islands and hence 
more chaos. 

The aim of our control strategy is to tailor appropriate perturbations / acting in the opposite 
direction, namely such that the Hamiltonian H^. = Hq + V + f has more smooth invariant tori 
and hence is more regular than H = Hq + V contrary to the conventional wisdom inherited 
from Chirikov's criterion. For practical purposes, the control term should be small with respect 

^ Unite Mixte de Recherche (UMR 6207) du CNRS, et des universites Aix-Marseille I, Aix-Marseille II et du Sud 
Toulon- Var. Laboratoire affilie a la FRUMAM (FR 2291). 



to the perturbation V, and localized in phase space (i.e. the subset of phase space where / is 
non-zero is finite and small). 

In this article, we highlight a method of control on a specific and paradigmatic example, the 
forced pendulum. We compute explicitly the formula of the control term which is able to create 
an isolated barrier of transport. We show that not only our method of control provides a control 
term which is much smaller than the perturbation but it also provides the explicit location of 
the created invariant torus which is a crucial step in order to localize the action of the control. 



2. Statement of the localized control theory 

The localized control method has been extensively described in Ref. |S] where the corresponding 
rigorous mathematical results were proved. We state here the main result of this paper. For a 
Hamiltonian system written in action-angle variables with L degrees of freedom, the perturbed 
Hamiltonian is 

H{A,e) = u;-A + ViA,e), 

where (A,0) G x and is a non-resonant vector of M^. Without loss of generality, we 
consider a region near A = (by translation of the actions) and, since the Hamiltonian is nearly 
integrable, the perturbation V has constant and linear parts in actions of order e, i.e. 

V{A,e)=ev{e)+ew{e)-A + Q{A,e), (1) 

where Q is of order 0(|| A|p). We notice that for s = 0, the Hamiltonian H has an invariant torus 
with frequency vector at A = for any Q not necessarily small. The controlled Hamiltonian 
we construct is 

H,{A, e)=u-A + V{A, 6) + f{e)n{A, 0), (2) 

where is a smooth characteristic function of a region around a targeted invariant torus. We 
notice that the control term / we construct only depends on the angle variables and is given by 

fie) = vio,0)-vi-rdeV{o,e),0), (3) 

where F is a linear operator defined as a pseudo-inverse of u ■ de, i.e. acting on V = J2]s. Vke*^ **^ 
as 

rv= y -^e*«^ 

Note that / is of order e^. This can be seen from Eq. since / can be rewritten as 

f{e) = e^^iO) ■ Tdev - Q {-eVdev, 6) , 

and Q is quadratic in the actions. Here the dependence of the control in the actions A is in 
the function J7. For any perturbation V , Hamiltonian ((2)) has an invariant torus with frequency 
vector close to u. The equation of the torus which is constructed by the addition of / is 

A = -TdeV{0,e), (4) 

which is of order e since T^(0, 0) is of order e. There is a significantly large freedom in choosing 
the function fi. It is sufficient to have Q,{A,6) = 1 for ||A|| < e. For instance, J7(A,0) = 1 
would be a possible and simpler choice, however representing a long-range control since the 
control term f{9) would be applied on all phase space. On the opposite way, we can design a 
function Vt such that the control is localized around the created invariant torus. The support 
of the function is reduced to a small neighborhood of the torus A = —Td0V{Q,6). The main 
advantage of this step function is that it needs fewer energy (only in the part of phase space 
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Figure 1. for a 
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where the control is localized) and also it does not change the other part of phase space, not 
altering the overall chaotic structure of the system. In particular, the dynamics is not changed 
in the region of the dominant resonances. Therefore a clever choice for the localization is 



where the parameters a = sup{x S M.'^ ,Q.ioc{x) = 1} and j3 = sup{x G M+,il;oc(x) ^ 0} are 
small and ^loc is sufhciently smooth on (for instance of class C^). One example of O^oc is 
depicted on Fig. ^ 

Remark : The amplitude of the control term is proportional to e^. However, if the aim of 
the control is to create a given invariant torus (e.g., specified by its frequency w), the control 
only makes sense if the invariant torus with frequency lo does not already exist in the original 
(uncontrolled) system. In other words, for e < ec{u)) where £c{^) is the threshold of break- 
up of the invariant torus, there is no need of control since the uncontrolled Hamiltonian has 
an invariant torus acting as a barrier (or an effective barrier) to diffusion. However, we point 
out that, below the critical threshold £c{^)^ the specific location of the invariant torus in the 
uncontrolled system is not known exactly in general (this is in particular the case for the forced 
pendulum described below). With a small modification of the potential (adding the proposed 
control term), there is an exact formula Q giving the equation of the torus. 

In the next section, we will see on a specific example that the amplitude of the control term 
is small compared with the perturbation. We notice that it was the case for E x B drift motion 
which was considered in Refs. |^ Ej and that it was also the case for the experimental control 
in the traveling wave tube (TWT) [Tn] . 

3. Application to the forced pendulum 

We consider the following forced pendulum model 



If we consider the Chirikov's criterion, it leads to an estimate of the threshold of large scale 
chaos £ = 0.0625 111 . In fact, the mechanism of the transition to chaos is much more complex 
than what it is hinted by this empirical criterion. Several methods have been developed since 



ii = nioc{\\^ + Td0V{Q,e)\\) 



H{p, X, t) = -p^ + £ [cos X + cos(x — t)] . 



(5) 
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Figure 2. Poincare surface of section of Hamiltonian ^ with e = 0.065. 

to get much deeper insight into the mechanism and also to get more accurate values of the 
transition to chaos (e.g., Greene's residue criterion [12 , 13 , frequency map analysis jl41ll5j and 
renormalization method [Sj). The large scale diffusion is due to the break-up of the last KAM 
torus. For this model, the last invariant torus is the one with frequency w = (3 — \/5)/2 and 
its critical threshold is e ~ 0.02759 A Poincare surface of section is depicted on Fig. I^lfor 
£ = 0.065. As expected, a large chaotic zone takes place between the two primary resonances 
since all the KAM tori are broken for this value of e. 

A first and simple idea to control the system would be to reduce the amplitude of one of the 
two primary resonances by considering the following control term which is of order e : 

t) = -5e cos{x - t), 

where 5 is an additional control parameter. In this case the control term becomes 

Hc{Pi X, t) = -p^ + e [cos X -\- {1 — 5) cos(x — t)] . (6) 

Figure 01 shows a Poincare section of Hamiltonian © for e = 0.065 and 5 = 0.5. As expected 
the size of the upper resonance decreases but this significant reduction of a primary resonance 
(which results in a decrease of the Chirikov parameter) does not succeed in creating an invariant 
torus in between the two resonances. 

In order to create an invariant torus, one needs to choose 0.7 < 6 <1 which requires too much 
energy for the control. In addition, even if 5 satisfies the required condition, there is no explicit 
formula for the equation of the created invariant torus which is crucial in order to localize the 
control term and hence to reduce drastically the amount of energy necessary for the control. 
Therefore one has to design another strategy which has two main goals : 

• find a small control term / which creates an invariant torus between the two resonances, 

• know explicitly the location of the created invariant torus in order to localize the control. 

In what follows, we show that the method proposed in Ref. [Hj gives a much smaller control term 
(of order e^) such that it creates an invariant torus whose equation is explicitly known. 

In order to compute this apt control term, this Hamiltonian with 1.5 degrees of freedom 
is mapped in the usual way into an autonomous Hamiltonian with two degrees of freedom by 
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Figure 3. Poincare surface of section of Hamiltonian ^ with e = 0.065 and 5 = 0.5. 

considering that t mod 2tt is an additional angle variable. We denote E its conjugate action. 
The autonomous Hamiltonian is 



The aim of the localized control is to modify locally Hamiltonian and therefore ©, in order 
to reconstruct an invariant torus with frequency iv. We assume that uj is sufficiently irrational 
(diophantine) in order to fulfill the hypotheses of the KAM theorem. First, the momentum p is 
shifted by lv in order to define a localized control in the region p ~ 0, i.e. to get the invariant 
torus located near p ^ uj for Hamiltonian Q for e sufficiently small. The operator F is defined 
from the integrable part of the Hamiltonian which is linear in the actions {E,p) : 



H = E + — + e [cos X + cos(x — t)] . 



(7) 



Ho{E,p) =E + ujp, 




(8) 



U{p,x,t)= Uk.MiPy'^''''^'''^ 



(fci,fc2)ez2 



is given by 




For the forced pendulum ©, we have 



rd^V{0,x,t) =e 



COSX COS X — 



LO UJ — 1 



The control term given by Eq. is equal to 



,,9 fcosx cos(x — t) 

f{x,t) = - {Td^V{0,x,t)f = -- + ^ , ' 

2 2 \ UJ UJ — 1 



(9) 



With the addition of the control term given by Eq. Q, the controlled Hamiltonian has an 
invariant torus whose equation is 



Po{x,t) =LO-e 

The controlled Hamiltonian is given by 
1 



cos X cosix — t) 
+ —T^ 

UJ UJ — 1 



(10) 



Hc{p, x,t) = -p + e [cos x + cos(x - t)] - — 



where we will consider two cases for il: 



e f cos X cos[x — t) 



+ 



UJ - 1 



n{p,x,t), (11) 



n{p,x,t) = 1, 

^l{p,X,t) = Qloc{\p- PQ{x,t)\), 

and Qioc ■ IR"*" — > [0) 1] will be specified below. We notice that we can subtract to the control 
term / any function which is constant in t. In particular, we can substract to the control 
term its Fourier components with k = (0, k) for any k £ Z. This can be seen by looking at 
Hamilton's equations and, since O is constant (equal to 1) in the region near the invariant torus, 
the equations of motion are the same in this region with or without the function depending only 
on time. Therefore the control term can be reduced to three Fourier modes 



cos2x cos2(x 



4(1 



t) ^ cos(2x-t) 
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Remark : We consider a forced pendulum when there are two parameters, one for the size of 
the primary resonances and another for the distance between them : 



H{p,x,t) 



p- 



+ £d[cos x + cos(3; — dt)]. 



(12) 



By rescaling the actions and by rescaling time, this Hamiltonian reduces to the forced 
pendulum with e = Sd/d?- If we fix the value of e to the value of the break-up of the 
last KAM surface Ec ~ 0.02759 (or to another value greater than this one, representing the 
degree of chaoticity in the model) , then we have ~ d^. If we compute the control term in the 
original variables for a rescaled frequency duj (since we want to keep uj g]0, 1[), it leads to the 
following control term : 

fd{x,t) 



5l 

d2 



cosx cos X 

+ — ^ 



t) 



UJ 



UJ 



1 



If we fix the degree of chaoticity e constant and eliminate the parameter cZ, the amplitude of the 
control term is proportional to ££d- Therefore the control term is of order £d for the model (|12|) . 
The fact that fd is also proportional to e which is in general small, makes the control term for 
Hamiltonian (|12|) very small compared with the size of the perturbation. 
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Figure 4. Poincare surface of section of the controlled Hamiltonian (jllj) with e = 0.065 and 
= 1. 

We consider the following norm of a function U{x, t) as 

||f7|| = max \U(x,t)\. 

The norm of the perturbation is 

\\V\\ = 2£, 

and the norm of the control term given by Eq. Q is 

^2 



" 4^2(1 -a;)2- 

Therefore the ratio r between the norm of the control term and the perturbation is given by 



e 



8u;2(i_^)2- 



The ratio r is smaller when lo is close to 1 /2 and large when it is close to the primary resonances 
w ~ or 1. For instance, for e = 0.034 and to close to 1/2, this ratio is approximately 7%. For 
the numerical computations we have chosen lo = {3 — \/5)/2 and s = 0.065. For these values of 
the parameters, the ratio r is about 15%. 

A Poincare section of the controlled Hamiltonian 1)11(1 for e = 0.065 shows that a lot of 
invariant tori are created with the addition of the control term precisely in the lower region of 
phase space where the localization has been done (see Fig. 

The next step is to localize / given by Eq. ^ around the invariant torus created by / whose 
equation is given by Eq. (jlOj) . More precisely, we have chosen Qioc{x) = 1 for < a, Qioc{x) = 
for X > (3 and a third order polynomial for x s]a, /?[ for which ^loc is a C^-function, i.e. 
^ioc{x) = 1 - {x - a)2(3/9 - a - 2x)/{/3 - a)^. We have chosen a = 10"^ and f3 = 1.5a. The 
support in momentum p of the localized control is of order 10"^ compared with the support of 
the global control which is of order 1. Therefore the localized control term requires less than 
0.5% of the energy of the perturbation. 

Figure El shows that the phase space of the controlled Hamiltonian is very similar to the one 
of the uncontrolled Hamiltonian. We notice that there is in addition an isolated invariant torus. 
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Figure 5. Poincare surfaces of section of the controlled Hamiltonian with e = 0.065 and 
initial conditions launched from (a) below the invariant torus and (6) from above for 0, = 
as defined in the paper. 




Figure 6. Poincare surface of section of the controlled Hamiltonian with e = 0.065 and 
n = n lac as defined in the paper : local dynamics around the recreated invariant torus for 
a = 0.01 (left panel) and for a = 0.002 (right panel). 



A complete barrier to diffusion is then created. Since the control is robust, we notice that there 
is also the possibility of reducing the amplitude of the control (by a few percent, see Ref. ^) and 
still get an invariant torus of the desired frequency for a perturbation parameter e significantly 
greater than the critical value in the absence of control. Also, there is the possibility in selecting 
appropriate Fourier coefficients of the control term and still get the selected invariant torus. 

Figure IHl shows a Poincare surface of section of the controlled Hamiltonian in a small 
region around the invariant torus given by Eq. (|10() . In addition to the creation of the invariant 
torus, we notice that the effect of the control term is also to regularize a small neighborhood 
of the invariant torus. We have represented this local dynamics for two different values of the 
parameter a : for a = 0.01 on the left panel and for a = 0.002 on the right panel. We notice 



that this regularized neighborhood can be chosen arbitrarily small (by choosing arbitrarily small 
values for a). Moreover, we notice that this barrier persists to arbitrarily large values of the 
coupling parameter e. 
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